Aug 26
14

OpenAI Says Robots.txt May Not Apply To ChatGPT’s Fetch Bot via @sejournal, @MattGSouthern

New data shows ChatGPT’s page-fetching bot is reaching sites that have disallowed it, and OpenAI’s own documentation explains why the file may not stop it. The post OpenAI Says Robots.txt May Not Apply To ChatGPT’s Fetch Bot appeared first on Search Engine Journal

Read the original here:
OpenAI Says Robots.txt May Not Apply To ChatGPT’s Fetch Bot via @sejournal, @MattGSouthern

Tags: ,

This entry was posted on 2026/08/14 at 7:10 pm. You can follow any responses to this entry through the RSS 2.0 feed. Responses are currently closed, but you can trackback from your own site.

Posted in SEO by admin No Comments Yet

Comments are closed.